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Analysis apparatus and method comprising auto-focusing means 



The present invention relates to an analysis apparatus, in particular a 
spectroscopic analysis apparatus, for analyzmg an object, such as the blood of a patient, and a 
correspondmg analysis method. Further, the invention relates to an optical focusing system 
for focusing on a target point of an object. 
5 In general, analysis apparatuses, such as spectroscopic analysis apparatuses, 

are used to investigate the composition of an object to be examined, e.g. to measure the 
concentration of various analytes in blood in vivo. In particular, analysis apparatuses employ 
an analysis, such as a spectroscopic decomposition, based on mteraction of the matter of the 
object with incident electromagnetic radiation, such as visible light, mfi-ared or ultraviolet 
10 radiation. 

A spectroscopic analysis apparatus comprising an excitation system and a 
monitoring system is knovm fiom WO 02/057759 A2 which is incorporated herem by 
reference. The excitation system emits an excitation beam to excite a target region during an 
excitation period. The monitoring system emits a monitoring beam to image the target region 

15 during a monitoring period. The excitation period and the monitoring period substantially 
overlap. Hence the target region is imaged together with the excitation, and an image is 
formed displaying both the target region and the excitation area. On the basis of this image, 
the excitation beam can be very accurately aimed at the target region. 

The analysis method known fix^m WO 02/057759 A2 for simultaneous 

20 imaging and spectral analysis of a local composition is done by separate lasers for confocal 
video imaging and Raman excitation or by use of a single laser for combmed imaging and 
Raman spectroscopic analysis. Orthogonal polarized spectral imaging (OPS imaging), which 
is also described m WO 02/057759 A2, is a simple, mexpensive and robust method to 
visualize blood vessels close to the sur&ce of organs which can also be used to visualize 

25 blood capillaries in the human skm. Blood capillaries close to tiie skin surface have a 

diameter of about 10 \m. Due to confocal detection the source of collected Raman signals is 
well confined in all three dunensions mside a spot of a size smaller than 2x2xg |xm^. This 
allows collecting Raman signals from blood without background signal from skin tissue if the 
focus is located in a blood capillary. This spot location is possible if die lateral position of the 



PCT/IB2004/0509I1 



,4 DEC 2005 



wo 2004/111621 



PCT/IB2004/050911 



blood vessel as well as the depth of the vessels below the skin surface are known with a 

resolution of 1 |xni or better. 

OPS imaging for blood vessel detection is also described in detail in European 

patent application 03 100689.3. The analysis apparatus described therein produces a contrast 
S image in a contrast wavelength range and a reference image m a reference wavelength range, 

said images being compared to accurately identify the target region^ notably a capillary blood 

vessel in the patient's skin. 

Because of an effective back«illumination of blood vessels, OPS imaging is 

essentially a 2-dimensional technique. The only depth information is obtained by the 
10 influence of the amount of (de)focus on the images. If an objective with a numerical aperture 

(NA) higher than 0.8 is used, tihie depth of field in skin is below 0.5 ]im. Therefore, with 

accurate focusing algorithms based on image analysis it is possible to find the depth of the 

blood vessel. 

Known auto-focusing methods are based on scanning the axial position of the 

1 5 objective focusing the imaging beam and the confocal excitation beam onto the object of 
interest, while measuring the value of a merit fimction to quantify Ihe amount of (de)focus in 
the unage. The best focus is found by optimizing the value of the merit function. In general 
there are many possibilities to change Ihe focus position. For instance, one or two l^es in 
tiie objective can be moved (as in a photo camera) or the whole objective lens or anotiier lens 

20 in the system can be moved. Also the shape of an optical element in tiie system can be 

changed, for example an electro wettmg optical element However, if the object is not known, 
the maximum of the merit function is also unknown. Therefore, the merit function provides 
only information about the amount of focus in relation to otiier focus positions. 

Patients will move in lateral as well as in transversal directions. Therefore, 

25 continuous measurement and adjustment of tiie optimal location of the confi>cal detection 
center is required. Transversal movements in the image plane can easily be detected, whereas 
axial movements (perpendicular to the detection plane) are much more difficult to detect. A 
common method of detecting axial movement or defocus is by continuously moving the 
detection plane around the central best focus position (so called wobbling). This can be done 

30 by moving the imaging objective or another optical element in the imaging system. If the 
focus becomes better in front or behind the central position, the central position of the 
objective is changed. In known systems the detection volume is located m the image plane. 
Therefore this detection volume is also continuously moved around the best measurement 
position. This has the disadvantage that the confocal detection volume is located inside a 
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blood vessel for only a fraction of time, and to avoid mixing of skin spectra with blood 
spectra, the intake of Raman signal has to be gated. This increases the time needed to collect 
sufficient Raman signal, which is in case of continuous recordmg aheady at least 30 sec. 

Further disadvantages are, that due to changes m the blood flow the shape and 
5 size of a capillary change continuously; so that comparing images acquued at different times 
add uncertainty to the position of best focus. Additionally, the fact that more time is needed 
to collect sufficient Raman signal adds to the noise in the Raman spectrum because more 
dark current is acquired or because more readout noise is added. 

It is therefore an object of the present invention to provide an optimized 
10 analysis apparatus and a corresponding analysis method for imaging and spectroscopic 

analysis of an object which allow continuous accurate auto-focusing of the excitation beam 
onto the object, in particular a blood vessel, even during movements of the object without 
changing the position of the detection volume continuously. Further, an optical focusing 
system for focusing on a target pouit of an object shall be provided, which system can, for 
15 instance, be applied in a tracking system for continuously tracking the target pomt in a 
. movmg object 

This object is achieved according to the present invention by an analysis 
apparatus as claimed in claim 1 comprising: 

- an excitation system for emitting an excitation beam to excite a t£|iget region, 

20 - a monitormg system comprismg a monitoring beam source for emittmg a monitoring beam 
and an imaging system to im^e the target region, 

- a detection system for detectmg scattered radiation from the target region generated by the 
excitation beam, 

focusing means for focusing the excitation system, the monitoring system and the detection 
25 system on a detection plane in the target region, 

- image processing means for determming image characteristics, which indicate if the 
imaging system is focused on the object to be analyzed, from a detected unage, and 

- auto-focusing means for controlling the focusing means to change the focusing of the 
monitoring system, the excitation system and the detection system based on the determined 

30 image characteristics, for controlling the monitormg system to image the target region and for 
controlling the image processmg means to determine the image characteristics from a 
detected image until the object substantially lies in the detection plane. 

The object is further solved by a correspondmg analysis method as claimed in 
clahn 11. Preferred embodiments of the mvention are defined in the dependent claims. 
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The inveation is based on the idea to evaluate the detected image, to detennine 
certain image parameters and to conclude therefrom if the imaging system, and thus also tiie 
excitation system and the detection system are focused on the object which shall be analyzed 
The detenmned hnage characteristics are used to decide if the focusing needs to be changed 

S or not If the object does not yet lie in the detection plane, or in other words, if the focusmg is 
not yet sufficient, the focusing is changed whereafter a new image is detected and new image 
characteristics are determined therefrom in order to again check if the focusing is sufficient 
This recursive procedure can be executed continuously during analysis of the object in order 
to ensure that the Raman confocal detection volume can be continuously located exactly 

10 inside the object of interest (such as a blood vessel). 

Compared to other known auto-focusing techniques the present mvention 
provides the advantage that the confocal detection volume is continuously located in the 
center of the object of interest, even if the object moves during the measurement According 
to preferred embodiments no moving elements are required and a single microscope objective 

1 5 having a high numerical aperture can be used as focusmg means. No continuous movement 
of tiie detection plane around the central best focus position (wobbling) is required. Another 
advantage of tiie present inv^tion is that a simple, &st and robust (relative) focus measure is 
obtained which is requhed for many focusing methods, such as for continuous tracking 
methods or for just finding the right deptih of a blood vessel a smgle time (e.g. before a 

20 Raman measurement to locate the depth of a capillary blood vessel). 

Different image parameters are available which allow an indication if the 
imaging system is focused on the object of interest According to a preferred embodiment as 
claimed in claim 2 tiie spatial frequencies corresponding to typical characteristics of the 
object of interest, e.g. to typical diameters of blood vessels during in vivo analysis of blood, 

25 are determined from a detected image. Since in focus tiie amplitudes of such spatial 
frequencies are maximally tiie focusing is changed until the determined amplitudes are 
maxunally. 

According to another preferred embodiment as claimed in claim 4 the 
maximum contrast present in a detected unage and/or at one or more image portions 
30 corresponding to the object or object portions, e.g. the maximum contrast present in a 
detected image between blood and surrounding tissue, in particular at the edges of blood 
vessels, during in vivo analysis of blood, are determined. Since in focus the contrast is 
maximally, the focusing is changed until the determmed contrast is maximally. 
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Preferred embodiments based on maximizing the contrast are defined in 
dependent claims 6 to 9. 

It is preferred that the monitoring system is adapted for orthogonal polarized 
spectral imaging as mentioned above and as described in WO02/057759 Al and in European 
5 patent application 03 1 006893 . 

The invention can not only be used in an analysis apparatus as described 
above, but relates also to an optical focusing system for focusing on a target pomt of an 
object, comprismg a target system to be focused on the target pomt, a monitoring system, 
focusing means, image processing means and auto-focusing means as claimed in claim 12. 
10 The invention can be used in every system where an imaging system is used to locate and 
continuously track a target pomt, for example the focus of a laser beam or the detection 
volume of a spectroscopic system, continuously in 3 dimensions at a specific position in a 
movmg target Examples include: (biomedical) laser surgery, laser cutting, laser welding, 
laser shavmg, photoc^amic therapy, remote sensing, and target and tracking in militaiy 
15 applications. Also the above described analysis apparatus could be regarded as mcluding 
sudi an optical focusing system. 

The invention will now be explained in more detail with reference to Fig. 1 
< which shows a graphic representation of an embodiment of an analysis system according to 
the present invention. 

20 Fig. 1 is a gmphic representation of a preferred embodiment of an analysis 

system m accordance with the invention. The analysis system includes an optical monitoring 
system (Iso) for forming an optical image of the object (obj) to be examined. In the present 
example the object (obj) is a piece of skin of the foreami of the patient to be examined. The 
analysis system also includes a multi-photon, non-linear, elastic or inelastic scattering optical 

25 detection system (ods) for spectroscopic analysis of light generated in the object (obj) by a 
multi-photon, non-linear, elastic or inelastic optical process. The example shown in Fig. 1 
utilizes in particular an inelastic Raman scattering detection system (dsy) in the form of a 
Raman spectroscopy device. The term optical encompasses not only visible light, but also 
ultraviolet radiation and infixed, especially near-infiio'ed radiation. 

30 The monitoring system (Iso) comprises a monitoring beam source (Is) for 

emittmg a monitoring beam (irb) and an imaging system (img) for imaging the taiget region, 
e.g. a blood vessel (V) in the upper dermis (D) of the patient's forearm (obj). The monitoring 
beam source (Is) in this example comprises a white light source (las), a lens (11) and an 
interference filter (not shown) to produce light in the wavelength region of 560-570 nm. 
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Further, a polarizer (p) for polarizing the monitoring beam (irb) is provided. The monitoring 
beam source (Is) is thus adapted for orthogonal polarized spectral imaging (OPS imaging). 

In OPS imaging polarized light is projected by a microscope objective (mo) 
through a polarizing beam splitter (pbs) onto the skin (obj). Part of the light reflects directly 

5 from the surface (specular reflection). Another part penetrates into the skin where it scatters 
one or more times before it is absorbed or is re-emitted from the skin surface (diffuse 
reflection). In any of these scattering events the polarization of the mcident light is slightly 
changed. Light that is directly reflected or penetrates only slightly into the skin will scatter 
only one or a few tunes before it is re-emitted, and will mostly retain its initial polarization. 

10 On the other hand, light that penetrates more deeply into the skin undergoes multiple 

scattering events and is completely depolarized before re-emitted back towards the surface. 

When looking at the object (obj) through a second polarizer or analyzer (a), 
oriented precisely orthogonal to that of the first polarizer (p), light reflected from tiie sur&oe 
or the upper parts of the skin is largely suppressed, whereas light that has penetrated deep 

1 S into the skin is mosfly detected. As a result the image looks as if it were back-illuminated. 
Because wavelengths below 590 nm are strongly absorbed by blood, the blood vessels appear 
daik in the OPS image. 

Generally, an image is obtained using a monochrome CCD camera. Blood 
vessels are separated from other absorbing structures be means of size» shape and movement 

20 of blood cells. The imaging system (img) used in the present embodiment comprises an 

analyzer (a) mentioned above for allowing only light having a polarization orthogonal to the 
light of the polarized monitoring beam (irb) to pass which is reflected back through the 
polarizing beam splitter (pbs) from the object (obj). Said light is further focused by a lens (12) 
onto the CCD-camera (CCD). 

25 The Raman spectroscopy device (ods) comprises an excitation system (exs) 

for emitting an excitation beam (exb) and a detection system (dsy) for detection of Raman 
scattered signals from the target region. The excitation system (exs) can be constructed as a 
diode laser which produces the excitation beam in the form of an 785 nm mfrared beam 
(exb). Of course other lasers can be used as excitation system as well. A system of murors 

30 and, for instance, an optical fiber conduct the excitation beam (exb) to a dichroic mirror (fl) 
for conducting the excitation beam (exb) along the monitoring beam (irb) to the microscope 
objective (mo) for focusmg both beams onto the object (obj). 

The dichroic mirror (fl) also separates the return (monitoring) beam from 
scattered Raman signals. While the reflected monitoring beam is transmitted to the imaging 
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system (img), elastically and inelastically scattei^ Raman light from tiie object is reflected at 
the dichroic mirror (fl) and conducted back along the light path of the excitation beamu 
Inelastically scattered Raman light is then reflected by an appropriate filter (f2) and directed 
along the Raman detection path in the detection system (dsy) to the input of a spectrometer 
5 with a CCD detector. The spectrometer with the CCD detector is incorporated into the 
detector system (dsy) which records flie Raman spectrum for a wavelength range of 800 to 
1050 nm. The output signal of the spectrometer with the CCD detector represents the Raman 
spectrum of the Raman scattered mfrared light The signal output of the CCD detector is 
coimected to a spectrum display unit, for example a workstation that displays the recorded 
1 0 Raman spectrum on a monitor. Also a calculation unit (e.g. a workstation) is provided to 
analyze the Raman spectrum and calculate the concentration of one or more analytes. 

Regardmg further details of the analysis apparatus m general and the function 
thereof reference is made to the above mentioned WO 02/057759 Al and to European patent 
application 03 100689.3. 

1 5 To achieve continuous auto-focusmg of tihe confocal Raman system (ods) in a 

blood vessel (V)» image processmg means (ipm) and auto-focusing means (afiba) are 
provided. Such auto-focusing is required to locate a blood vessel and to aim the Raman 
' . syst^ at this blood vessel. Smce patients will move during a blood analysis in lateral (z) as 
well as m transversal (x, y) directions, continuous determination and adjustment of the 

20 optimal location of the confocal detection center is reqmred. Transversal movements can be 
easily detected by the imaging system, whereas axial movements are much more difficult to 
detect 

According to the present invention the image processing means (ipm) process 
an acquired image of the object (obj) and determine certain image characteristics which 

25 indicate if the imagmg system (img), and thus also the excitation system (exs) and the 

detection system (dsy) are focused on the object (obj), in particular a blood vessel (V) or not, 
i.e. if the object of interest (the blood vessel) substantially lies in the detection plane (dp) on 
which the microscope objective (mo) is focused. Actually, only a relative focus measure can 
be determined if the object is not known, therefore, a focus measure is always compared to a 

30 focus measure at a different position. The position with the highest (or lowest) value of the 
focus measure is the position with best focus. Different hnage characteristics allow such an 
mdication, preferably the amplitudes of spatial frequencies corresponding to typical 
diameters of blood vessels or the contrast between blood and surroundmg tissue. Based on 
the determined unage characteristics the auto-focusing means (afin) control the microscope 
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objective (mo) to change the focusing thereof accordingly, i.e. to improve the focusing if 
possible. After this change the monitoring system (Iso) is controlled to take another image of 
the object which is processed again by the image processmg means (ipm) in the same way m 
order to check if the focusmg has improved or not based on the same unage characteristics, 

5 now determined in the new image. This iterative procedure is executed continuously or at 
predetermined time intervals during the whole blood analysis to compensate for movements 
of the patient during the analysis. Another use is to determine the position of best focus 
before the Raman measurement is started. 

As mentioned above different image characteristics can be used. In the 

1 0 following preferred image characteristics which are used for automatic focusing in OPS 
imagmg of blood vessels according to the present invention will be explained. 

(1) A first preferred image characteristic is the typical dunensions of blood 
vessels. It is known that the blood capillaries near the skin surface have a typical diameter of 
10 |jm and a (visible) length of about 50 |imi. The 2-D spatial Fourier transform can be used 

IS to find the proper focus by maximizmg the amplitudes of spatial firequencies with 
wavelengths equal or shorter than tiiese typical dimensions. This can be used for 
monochromatic as well as bichromatic OPS imaging, bichromatic OPS imaging meaning 
OPS unaging with a contrast wavelength and a reference wavelength as described in detail in 
European patent application 03100689.3. 

20 (2) A second preferred image characteristic is the contrast between blood and 

surrounding tissue. Before discussing auto-focusing methods based on contrast, two general 
remarks have to be made. In bichromatic OPS imaging almost all structures visible after 
subtraction of the red and yellow/green image are blood vessels. Therefore any method based 
on maximizing the contrast of an image automatically selects blood vessels. However, in 

25 monochromatic OPS imaging, blood vessels as well as other structures near tiie skin surface 
are visible. Therefore, care has to be taken to focus only on blood vessels. Other structures 
can be suppressed by averaging over a number of pixels and/or using a high-pass spatial 
Fourier filter. In a monochromatic OPS unaging system the (preprocessed) image is used for 
image analysis and blood vessels appear as dark structures on a light background. In 

30 bichromatic OPS imaging the difference image (yellow/green minus red) is used for 
processmg and blood vessels appear as light structures on a dark background. 

Auto-focusing methods based on contrast can be divided into four categories. 
For all methods the average intensity of the image is kept constant 
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(a) Maximize or minimize the intensity of a single pixel as a function of depth. Light 
originating jfrom outside the focal plane (detection plane) will be spread over several 
pixels in the unage. By this spreading^ the intensity of bright areas decreases, whereas 
the intensity of dark regions increases. For monochromatic OPS imaging, blood 

5 vessels are more dark compared to surrounding tissue, hence blood vessels are in- 

focus if an image containing the darkest pbcel is obtained. For bichromatic OPS 
imaging, blood vessels are more bright compared to surrounding tissue; hence blood 
vessels are m-focus if an image containing the brightest pixel is obtained. 
Mathematically this can be expressed as maximizing (/, j )^ {z) or minimizing 

1 0 [if J (z) . Here (/, ^ )^ (z) and (/,^ )^ (z) represent the intensity of the pixel 

with maximum or minimum intensity when the imaging system is focused at a depth z 
below the skin sur&ce. 

(b) Maximize the spread in mtensity of pfacels as a function of depth. Because light 
15 originating from outside the focal plane will be spread over several pixels in the 

image, the spread in the intensity distribution will decrease if blood vessels are out of 
focus. The best focus can be obtained by maximizing ^{l^ (z) - i{z)f . Here 

If J (z) is the intensity measured at a pfacel with coordinates i J and /(z) is the intensity 

averaged over all pixels when Ae imaging system is focused at a depth z below the 
20 skin surface. 

(c) Maxunize the average intensity difference between neighboring pixels as a function 
of depth. Because light originating from outside the focal plane will be spread over 
several pixels m the unage, the average mtensity difference between adjacent pixels 

25 will decrease if the vessels are outside the focal plane. The best focus can be obtained 

by maximizing J,[hj{z)-h,^j{z)f -^{l,j{z)-I,j,,(z)f . 
u 

(d) Maxunize absolute difference between neighboring pixels as a function of depth. 
Instead of looking at the average intensity difference between neighboring pixels in 

30 the whole image, the best focus can be found by looking for the unage with the 
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largest contrast between neighboring pixels. Mathematically this can be expressed as 
maximizing (2) + 

Each of the methods described above has its own advantages and 
5 disadvantages. Method (2a) has the advantage that only a single pbcel (belonging to a single 
blood vessel) is considered. By maximizmg &e contrast, automatically the center of the 
thickest blood vessel close to the skin sur&ce is selected. This is also the position that can be 
used most conveniently for Raman spectroscopic analysis of blood. Method (2d) looks at the 
edge of a single blood vessel. Therefore at a single blood vessel is focused, however, the 
10 optimum Raman measurement position is located in the center of the vessel. Because only 
one or two pixels are used in methods (2a) and (2d), these techniques are sensitive to noise. 

Methods (1), (2b) and (2c) use the whole image to find the best focus, and 
therefore are less sensitive to noise. However, they find the best focus of multiple blood 
vessels. If these vessels are not on the same depth, the focal plane can lie in between the 
1 5 vessels. This problem can be solved using a region of interest containing a single blood 
vessel for focusing. 

The contrast difference is only detectable for structures small compared to the 
intensity spreading due to defocus. Therefore defocus can easily be detected near the edge of 
structures. This is done m methods (2c) and (2d). The mtensity m the center of the image of 
20 an object only changes due to defocus that causes a spread larger than the image of the 
. structure. Methods based on the maximum or minimum intensity (2a) are therefore less 
sensitive to defocus. 

Another preferred embodunent will be a combination of auto-focusing 

algorithms. 

2S 1 . Use bichromatic OPS imaging to detect only structures that are caused by absorption 
of blood 

2. Fmd the best average focus for multiple blood vessels by maxunizmg the average 
intensity difference between neighboring pixels (method 2c). 

3. Select region of mterest containmg the image of a (part of a) single blood vessel. 
30 4. Fbid the best focus for this vessel by 

a. maximizing the average intensity difference between neighboring pixels (method 2c) 
or 

b. minimize the intensity of a single pixel. 
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The choice for a or b depends on how the absolute mtensity and the intensity 
difference depend on the amount of (de)focus. 

The complete image can be used for auto-focusing. However, different blood 
vessels or parts thereof lie at different depths below the skin surface. Therefore, it is more 
5 accurate to use a region of interest around the best Raman measurement position for auto- 
focusing. In a different application with higher quality unages, an acciu'acy of 1% of the 
depth of focus can be achieved with the mefliod according to the present invention. Thus, for 
automatic focusmg of the Raman excitation beam, the acquired accuracy in the order of 1 ^m 
can be obtained. 

10 In the above a monochromatic OPS imaging embodiment is described having 

a white light source and a filter. Nevertheless, the invention can be ^plied in many different 
embodiments including other monochromatic, bichromadc or multichromatic OPS imaging 
embodiments. 

Compared to known auto-focusing techniques, the method according to the 
1 5 present invention has tiie advantage that the confocal detection volume can be continuously 
located in the center of the blood vessel in which the blood shall be analyzed. The images 
that are evaluated are preferably measured continuously. Further, the mvention can be used 
as a simple, &st and robust (relative) method to obtain focus measure which can be used in 
many focusing mediods, e.g. for just finding the right depth of a blood vessel a single time. 



